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Election/Restrictions 

L Applicant's election without traverse of claims 25-45, 51- 58 and 70-84 in the reply filed 
on 06/02/2006 is acknowledged. 

Claim Objections 

2. Claim 25 is objected to because of the following informalities: 

a) Claim 1, line 3: "said first dimension" should be changed to "said second dimension". 
Appropriate correction is required. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 25-45, 51 and 52 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Applicant's admitted prior art in view of Itokawa (US Patent # 6,404,901). 

[Claim 25] 

Applicant's admitted prior art teaches a signal processing apparatus comprising means for 
acquiring second signals of a second dimension by projecting first signals as real-world signals 
of a first dimension on a sensor and by detecting the mapped signals by said sensor, said second 
dimension being lower than said first dimension (Paragraph 8). 

Applicant's admitted prior art fails to teach signal processing means for extracting the 
significant information, buried by said projection from said second signals, by performing signal 
processing which is based on said second signals. 
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However Itokawa teaches boundary area specification as taught in col. 10 lines 
45-59, figure 28 and the specifying the background and foreground areas other areas (col. 10 
lines 14-44, figure 28), said significant area (boundary area) containing the significant 
information buried by said projection is extracted (shape information being represented by a 
mixing ratio of the foreground and background as represented by equation 1, col. 10 line 60). 

Therefore taking the combined teachings of Applicant's admitted prior art and Itokawa, it 
would be obvious to one skilled in the art at the time of the invention to have been motivated to 
have signal processing means for extracting the significant information, buried by said projection 
from said second signals, by performing signal processing which is based on said second signals 
in order to easily perform a natural image synthesization while accurately reducing the boundary 
portion thereby making the image quality better for the user. 
[Claim 26] 

Applicant's admitted prior art wherein said significant information is the information for 
adjusting the distortion produced by projection (Paragraphs 8-10). 
[Claim 27] 

Applicant's admitted prior art teaches a CCD wherein a CCD is inherently made up of a plurality 
of detection elements having time integrating effects (shutter time, Paragraphs 4-6), said 
acquisition means acquiring a plurality of detection signals for said respective detection 
elements, as detected by said sensor, as said second signals, said distortion being the distortion 
caused by the time integrating effect (Paragraphs 7-10, It is noted that the motion blur increases 
or decreases with the increase in the time integration of a CCD. Therefore the distortion due to 
motion blur is caused due to the time integrating effects of a CCD). 
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[Claim 28] 

Itokawa teaches wherein said acquisition means acquire said detection signals of a plurality of 
time units (figures 12a and 12b, col. 6 lines 61-65), as detected by plural detection elements of 
said sensor every predetermined time unit; said signal processing means extracting said 
significant information for said second signal of a desired time based on plural detection signals 
of said plural time units (col. 7 lines 23-33, figure 14a-14e teach calculating motion vectors 
based on signals acquired by plural detection elements of the image sensor at plural time units). 
[Claim 29] 

Applicant's admitted prior art teaches wherein said second signals are picture signals (e.g. 
Paragraphs 2-4 teach a CCD that generates picture signals). 
[Claim 30] 

Itokawa teaches wherein said signal processing means includes area specifying means for 
specifying a significant area (boundary area specification as taught in col 10 lines 45-59, figure 
28) and the other areas in said second signal (col. 10 lines 14-44, figure 28, specifying the 
background and foreground areas), said significant area (boundary area) containing the 
significant information buried by said projection (shape information being represented by a 
mixing ratio of the foreground and background as represented by equation 1, col. 10 line 60), 
outputting the area information specifying the specified area as said significant information (col. 
10 lines 62-66, figure 29 shows mixed area pixels 702 and 703 and figure 31 shows the shape 
information comprising mixing ratio as taught in col. 1 1 lines 21-26). 
[Claim 31] 

See Examiner notes regarding rejection of claim 30. 



Application/Control Number: 09/830,858 Page 5 

Art Unit: 2622 

[Claim 32] 

Itokawa teaches wherein said area information contains the information for discriminating said 
mixed area into a covered background area and an uncovered background area (col. 6 lines 30- 
32). 

[Claim 33] 

Itokawa teaches wherein said signal processing means further includes significant information 
extracting means for extracting said significant information from an area containing said 
significant information specified by said area specifying means (shape information being 
represented by a mixing ratio of the foreground and background as represented by equation 1, 
col. 10 line 60 and figure 31 shows the shape information comprising mixing ratio as taught in 
col. 11 lines 21-2) 
[Claim 34] 

Itokawa teaches wherein said significant information specifies a mixing ratio of said foreground 
components and the background components in said mixed area of said second signal made up of 
a foreground area comprised only of foreground object components constituting the foreground 
objects, a background area comprised only of background object components constituting the 
background objects and a mixed area mixed from said foreground object components and said 
background object components (See equation 1 comprising mixing ratio of foreground area as A, 
background area as B and boundary area as M 5 col. 10 line 60). 
[Claim 35] 

Itokawa teaches wherein said signal processing means further includes distortion adjustment 
means for adjusting the amount of distortion produced in said second signal by said projection 
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based on said significant information (col. 1 lines 58-67 teach a motion blur being generated in 
the mixed area and col. 8 lines 30-49, figure 8 teach a motion compensation unit for adjusting the 
amount of motion blur). 
[Claim 36] 

Itokawa teaches motion compensation 108 (figure 8) that reduces the amount of said distortion. 
[Claim 37] 

Itokawa teaches motion compensation 108 (figure 8) that reduces the amount of said distortion 
(col. 5 lines 47-50) and therefore is considered to eliminate the amount of distortion. It is noted 
that the claim is broad and does not recite completely eliminating the amount of distortion. 
[Claim 38] 

Itokawa teaches wherein said distortion is movement blurring produced in said foreground object 
(col. 1 lines 58-67 states motion blur due to foreground objects and col. 6 lines 60-65 teach that 
the foreground object is moving and the background is not moved.). 
[Claim 39] 

Itokawa teaches wherein said signal processing means further includes object movement 
detection means for detecting the movement quantity of said foreground object (col. 7 lines 23- 
34, figures 14a-14e); and wherein said distortion adjustment means adjusts the quantity of 
movement blurring which is said distortion based on said movement quantity of said foreground 
object (e.g. motion compensation block 108 adjusts the motion blur of the movement block). 
[Claims 40-45] 

See Examiner's notes regarding rejection of claims 34-39 respectively. 
[Claims 51 and 52] 
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These are method and computer-readable claims corresponding to apparatus claim 25. Therefore 
they have been analyzed and rejected based upon apparatus claim 25. 

5. Claims 53-58 and 70-84 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Applicant's admitted prior art in view of Astle (US Patent # 5,812,787), 
[Claim 53] 

Applicant's admitted prior art teaches a signal processing apparatus comprising signal 
acquisition means for acquiring a second signal by detecting a first signal as a real world signal 
of a first dimension by a sensor, said second signal being of a second dimension lower than said 
first dimension and containing distortion with respect to said first signal (Paragraph 8). 

Applicant's admitted prior art fails to teach signal processing means for performing 
signal processing on said second signal for generating a third signal alleviated in distortion as 
compared to said second signal. 

However Astle teaches separating foreground and background components from the 
output of the sensor (col. 7 line 18 - col. 8 line 53, figures 1-4) and the foreground objects that 
move are motion compensated thereby generating a third signal that is alleviated in distortion as 
compared to said second signal (col. 9 lines 17-20, col. 10 lines 32-36). 

Therefore taking the combined teachings of Applicant's admitted prior art and Astle, it 
would be obvious to one skilled in the art at the time of the invention to have been motivated to 
have signal processing means for performing signal processing on said second signal for 
generating a third signal alleviated in distortion as compared to said second signal in order to 
have a picture that is high in quality compared to the distorted signal thereby the photographs 
look better to the user. 
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[Claim 54] 

Applicant's admitted prior art teaches wherein said sensor is made up of a plurality of detection 
elements having time integrating effects as said distortion (Paragraphs 4-6 describe a CCD that 
has plurality of pixels and uses electronic shuttering that is the same as integrating time of the 
CCD in order to remove the distortion), said acquisition means acquiring a plurality of detection 
signals detected by said sensor for said respective detection elements as said second signals 
(Paragraphs 4-6). Astle teaches separating foreground and background components from the 
output of the sensor (col. 7 line 18 - col. 8 line 53, figures 1-4) and the foreground objects that 
move are motion compensated thereby generating a third signal that is alleviated in distortion 
(col. 9 lines 17-20, col. 10 lines 32-36). It is noted that by compensating the motion blurred 
signal, the third signal is also alleviated in time integrating effects due to the time integration 
operation of the CCD because the motion blur increases or decreases with the increase in the 
time integration of a CCD. Therefore by compensating the motion blur as taught in Astle, the 
time integrating effects of a CCD are also alleviated. 
[Claim 55] 

Astle teaches wherein if a first object in the real world and a second object performing relative 
movement with respect to the first object are detected by said sensor (col. 7 line 18 - col. 8 line 
53, figures 1-4), said signal processing means alleviates, by said signal processing, the distortion 
caused by the mixing of said first object and the second object due to time integrating effects of 
said sensor in the vicinity of a boundary between said first and second objects (col. 9 lines 17- 
col. 10 line 36). See the explanation in claim 54 regarding time integrating effects. 
[Claim 56] 
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Astle teaches wherein said acquisition means acquire said detection signals of a plurality of time 
units, as detected by plural detection elements of said sensor every predetermined time unit (col. 
8 line 21 -col. 9 line 20, figures 3 and 4 teach how bitmaps 301 and 401 acquire two frames at 
different time units); said signal processing means alleviating, by said signal processing, the 
distortion caused in the vicinity of the boundary between said first and second objects 
represented by said second signal corresponding to a desired time unit based on said detection 
signal of plural time units (col. 9 line 48-col. 10 line 36 teach motion compensation on the 
foreground signals based on the blending ration R in the vicinity of foreground and background 
pixels corresponding to a desired bitmap 401 and based on bitmaps 301 and 401 acquired at 
different times). 
[Claim 57] 

Astle teaches wherein if a first object in the real world and a second object performing relative 
movement with respect to the first object are detected by said sensor, said signal processing 
means separates one of said first and second objects, from said first and second objects mixed in 
said second signal, to output the separated one of said first and second objects as said third signal 
(col. 7 line - col. 8 line 40, figure 3). 
[Claim 58] 

Astle teaches wherein said sensor converts light, as said first signal, into picture signals, as said 
second signal, by photoelectric conversion (col. 4 lines 50-65). 
[Claim 70] 

Astle teaches a signal processing apparatus (figures 1-5) for processing a predetermined number 
of detection signals acquired by a video camera (col. 4 lines 52-62). A video camera inherently is 
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made up of a predetermined number of detection elements having time integrating effects. Astle 
further teaches that the signal processing apparatus comprises area specifying means for 
specifying a foreground area made up only of foreground object components constituting an 
foreground object (col. 7 line 66-col. 8 line 3 teaches a separate foreground bitmap), a 
background area made up only of background object components constituting a background 
object (col. 7 lines 28-37, figure 3, background bitmap 302), and a mixed area mixed from said 
foreground object components and the background object components (col. 7 lines 37-39); 
mixing ratio detection means for detecting a mixing ratio of said foreground object components 
and said background object components at least in said mixed area (col. 9 line 48-col. 10 line 
20); and separating means for separating said foreground object and said background object from 
each other based on the specified results by said area specifying means and said mixing ratio 
(col. 10 lines 8-20 teach specifying a foreground pixel F and a background pixel B based upon 
blending ratio R that is the amount of mixing between foreground and foreground. Also see col. 
9 lines 48-col. 10 line 7). 
[Claim 71] 

Astle teaches movement blurring quantity adjustment means for adjusting the movement blurring 
quantity of said foreground object (col. 9 lines 17-20, col. 10 lines 32-36). 
[Claims 72, 73] 

These are method and computer-readable claims corresponding to apparatus claim 70. Therefore 
they have been analyzed and rejected based upon apparatus claim 70. 
[Claims 74-76] 

See Examiner notes regarding rejection of claims 70 and 71 . 
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[Claim 77] 

Astle teaches detecting motion vectors only for foreground objects (col. 8 lines 4-5) movement 
blurring quantity adjustment means for adjusting the movement blurring quantity of said 
foreground object based on the detected movement (col. 9 lines 17-20, col. 10 lines 32-36). 
[Claims 78, 79] 

These are method and computer-readable claims corresponding to apparatus claim 74. Therefore 
they have been analyzed and rejected based upon apparatus claim 74. 
[Claims 80-82] 

See Examiner notes regarding rejection of claims 70, 71 and 77 respectively. 
[Claims 83, 84] 

These are method and computer-readable claims corresponding to apparatus claim 80. Therefore 
they have been analyzed and rejected based upon apparatus claim 80. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Yogesh K. Aggarwal whose telephone number is (571) 272-7360. 
The examiner can normally be reached on M-F 9:00AM-5:30PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vivek Srivastava can be reached on (571)-272-7304. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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